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(54) Pipelined processing for moving picture compression bit rate control 



(57) A video compression process that involves 
pipelined processing for moving picture bit rate control 
reduces quantizer value variation by using a first pass 
compression engine which passes picture information 
to a transfer function. Using this information the transfer 



function establishes the quantizer value for a second 
pass compression encoder which compresses the 
same video image data as in the first pass. The desired 
bit rate is also adjusted according to the actual number 
of bits resulting from the second compression pass. 
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Description 

Background of the Invention 

[0001] The present invention relates to video comj 
pression techniques and more particularly to pipelined 
activity processing for moving picture connpression bit 
rate control by establishing the quantizer value for a sec- 
ond pass connpression engine from compressed video 
image data collected from a first compression pass in 
order to reduce apparent artifacts in the decoded mov- 
ing picture sequence. 

[0002] Moving picture compression algorithms involv- 
ing block based transforms (e.g. discrete cosine trans- 
form or DCT), quantization (i.e. loss of precision), and 
subsequent lossless coding such as in the Moving Pic- 
ture Expert Group (MPEG) and Motion-Joint Photo- 
graphic Expert Group (Motion-JPEG) standards, are of- 
ten targeted at constant bit rate or nearly constant bit 
rate applications. In order to achieve this, image quality 
is periodically adjusted by altering quantization. The pe- 
riod of adjustment can range from ( 1 ) block-to-block hor- 
izontally, (2) slice to slice vertically. (3) picture-to-picture 
or group-of-pictures to group-of-pictures temporally, or 
(4) a hybrid approach involving combinations of the 
above adjustment periods. Typically, a single pass algo- 
rithm provides feedback by using measures of generat- 
ed code volume against a target volume to adjust the 
quantizer for either the current or future blocks.. Previ- 
ously coded blocks are left unaffected. The result of this 
single pass method results in "artifact noise" due to 
modulation of the quantizer that can be readily observed 
in the temporal domain. 

[0003] Examples relative to the above quantizer ad- 
justment periods include (1 ) quality differences in similar 
image content areas left-to-right resulting in "bit-shad- 
ow" cast horizontally, (2) quality differences in similar im- 
age content areas top-to-bottom producing a "window 
shade" or vertically cast bit shadow and (3) quality dif- 
ferences in similar image content from picture to picture 
resulting in higher temporal frequency noise such as 
"mosquito noise" or lower temporal frequency noise 
such as "pulsing". When complex hybrid bit rate control 
is employed the effects can be mixed and self-sustain- 
ing (oscillatory) well above visual thresholds. In actual 
algorithms with real-world video inputs that contain 
noise as well as image content changes (cuts), these 
effects rarely are spatially static. For example, the "bit 
window-shade" can appear to be moving up and down 
the screen from picture to picture within a sequence. 
[0004] Techniques exist to reduce artifact motion for 
single pass bit rate methods. In general they result in 
either higher swings in the actual bit rate when trying to 
achieve higher overall quality or lower overall quality to 
achieve better regulation. These effects are increased 
when the compressed data is used in multiple genera- 
tions of encoding or decoding, such as in a non-linear 
editing system or cascaded video transmission system, 



even at relatively high bit rates (e.g. > 15 Mbits/sec). 
This effect is due primarily to changes in the quantizer 
values from compression pass to compression pass. 
[0005] What is desired is a video compression system 
5 that allows for a selection of quantizer values targeted 
at constant or nearly constant bit rate applications with 
the effect of reducing apparent artifacts in the subse- 
quently decoded moving picture sequences. 

10 Summary of the invention 

[0006] Accordingly, the present invention provides 
pipelined activity processing for moving picture bit rate 
control by reducing quantizer value variation for similar 
IS image segments within an encoded moving picture se- 
quence. It should be noted that in all cases a quantizer 
value does not represent a single value, but rather a ma- 
trix of values. The following method depends upon the 
matrix of values being scaled (linearly) by a single quan- 
go tizer multiplier, heretofore referred to as a "quantizer val- 
ue." The reduction in quantizer value variation is done 
by using a first pass compression engine which passes 
the picture information to a transfer function. Using this 
information the transfer function establishes the quan- 
25 tizer value for a second pass compression engine which 
compresses the same video image data as in the first 
pass. The desired bit rate is also adjusted according to 
the actual number of bits resulting from the second com- 
pression pass. This has the effect of reducing quantizer 
30 value variation in the compression of the video data for 
similar image segments within the encoded sequence. 
[0007] The objects, advantages, and other novel fea- 
tures of the present invention are apparent from the fol- 
lowing detailed description when read in conjunction 
35 with the appended claims and attached drawing. 

Brief Description of the Drawing 
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[0008] 

Fig. 1 is a system schematic of pipelined activity 
processing for moving picture compression bit rate 
control according to the present invention; 
Fig. 2 is a diagram showing a timing sequence of 
actions using a single compression encoder ac- 
cording to the present invention. 

Description of the Preferred Embodiment 



50 [0009] Referring to figure 1 , uncompressed video im- 
age data is input to a first pass compression encoder 5, 
along with a sample quantizer value. A JPEG engine 
may be used as the first pass compression encoder 5, 
and may be adjusted to use Huffman coding tables that 

55 are similar to the MPEG compression engine tables. 
However an MPEG Intra-Frame coding engine may be 
used as the first pass compression engine, as well as 
any compression engine that would provide as output 
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the number of bits resulting fronn the compression pass. 
The full image is compressed using the first pass com- 
pression encoder 5. However, a sampled subset of the 
image may also be processed using the first pass com- 
pression encoder 5 because the compressed image 
output is ignored. This is-done by taking a regular spatial 
subsample, such as checkerboarding or striping of pix- 
els or pixel groups. The first pass compressor encoder 
5 is coupled to a transfer function 1.. where the output 
number of bits from the first pass compression encoder 
is input into the transfer function 7. The sample quantiz- 
er value (Q-sample) is also Input to the transfer function 
7. Before any image is compressed, an accumulated er- 
ror output 20 is initialized to zero, and thus initially, the 
desired number of bits for a second compression pass 
(N-desired) is equal to the initial desired constant bit rate 
21 . The desired number of bits for the second compres- 
sion pass is then input to the transfer function 19. 
[0010] The transfer function 7, compares the sample 
quantizer value used in the first pass compression (Q- 
sample) and the total number of bits resulting from that 
compression (N-sample), with the number of desired 
bits based on previous accumulated error (N-desired), 
and determines a quantizer value (Q-recommended) to 
be used in the second compression pass. The transfer 
function 7 is coupled to a second pass compression en- 
coder 8 and the determined quantizer value (Q-recom- 
mended) is input to the second pass compression en- 
coder, as well as the uncompressed video image data 
of the first pass via a delay buffer 6. The delay buffer 6 
in this embodiment may be increased in size to store 
multiple pictures, such as a Group of Pictures (GOP) 
sized N, enabling information to be collected in a pipe- 
line over the entire GOP for use by the transfer function. 
The second pass compression encoder 8 used in this 
embodiment is an MPEG IPB (Intra and Inter Frame) 
compression encoder but it is not necessary to use this 
specific encoder The second pass compression encod- 
er 8 therefore compresses video image data that con- 
tains the uncompressed video image data processed in 
the first pass. The resulting compressed image is output 
from the second pass compression encoder 8. 
[0011] The input (N-Desired) to the transfer function 
7 for determining the quantizer value used in compres- 
sion of a subsequent video image segment is set based 
on an error between the actual number of bits resulting 
from the second compression pass and the desired con- 
stant bit rate 21. This is performed in the following man- 
ner The second pass compression encoder 8 is coupled 
to a subtracter 22. Input to the subtracter 22 is the actual 
number of bits (N-Actual) resulting from the second 
compression pass, and the desired number of bits re- 
sulting from the previous compressed image (N-De- 
sired). The actual (N-Actual) is subtracted from the de- 
sired (N-Desired) to get an error The error output from 
the subtracter 22 is accumulated in an accumulator 10, 
This output is then input into a gain controller 9 that re- 
duces the error by a percentage, say 50%, to avoid os- 



cillation. The output of the gain controller 9 is input to a 
second subtracter 23 that also has as input the desired 
constant bit rate 21 . The second subtracter 23 subtracts 
the gain controlled error output from the desired con- 

5 stant bit rate 21. This adjusted desired constant bit rate 
is then used as input for the number of bits desired in 
compression of a subsequent video image by inputting 
it to the transfer function 7 as the N-Desired parameter 
[0012] The transfer function continues in the cycle by 

^0 determining a desired quantizer value (Q-recommend- 
ed) at its output that results in a closer match between 
the number of bits desired (N-Desired), and the actual 
number of bits from the second compression encoder 
8. This is because the first pass compression encoder 

^5 5 provided the transfer function 7 with the actual number 
of bits resulting from compression using the sample 
quantizer The transfer function 7 is adjusted according 
to the data from the first compression pass to provide a 
more accurate recommended quantizer value for a giv- 

20 en desired constant bit rate. As the desired bit rate is 
adjusted according to the previous error, and a more ac- 
curate determination of the quantizer value results as 
output from the transfer function 1 , variations in the 
quantizer values for each similar image segment within 

25 the encoded sequence are decreased, thus reducing ar- 
tifacts. Also, to reduce quantizer value variation, the set 
of allowable quantizer values that is recommended for 
the second pass compression encoder 8 may be re- 
stricted, so as to increase the possibility that the actual 

30 quantizer value exactly matches quantizer values for 
similar identical, or previously ceded (multi-generation) 
images. 

[0013] A single compression engine may be used to 
store the input image and perform the two compression 

35 passes by sampling a subset of the input image and tak- 
ing advantage of the horizontal and vertical blanking 
time between active picture samples. Fig. 2 shows a 
representative sample of the horizontal and vertical 
blanking intervals between the active video portions of 

-^0 two input pictures N and N+1 . The subset sample of in- 
put picture N is taken by selecting a regular spatial sub- 
sample of the input picture N, by way of checkerboard- 
ing or striping of pixels or pixel groups during the hori- 
zontal blanking interval after the last active video line, 

^5 number 260 in this instance, of input picture N and dur- 
ing a portion of the vertical blanking period following said 
horizontal blanking interval. The processing, including 
the first pass compression of that sample and a quan- 
tizer adjustment based en that sample is completed dur- 

50 ing the remaining portion of the vertical blanking period 
between input pictures N and N+l after the subsample 
is taken. The full second pass compression of input pic- 
ture N is then completed during the normal time at which 
the compression encoder would compress the input pic- 

55 ture N, which spans the active video and horizontal 
blanking intervals of the following input picture N-i-1. 
[0014] Thus, the present invention provides pipelined 
activity processing for moving picture bit rate control by 
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using a two-pass compression technique, a first intra- 
f rame compression pass being used to determine quan- 
tizer values for a second intra-Zinter-frame compression 
pass with feedback to reduce quantizer value variations 
for the second compression pass. 5 

Claims 

1. A method for compressing digital video data, the to 
method comprising the steps of: 

performing a first compression pass of digital 
video data to obtain a number of bits resulting 
from the first compression pass; 
determining a quantizer value for a second 
compression pass of the digital video data as a 
function of the number of bits resulting from the 
first compression pass and a desired bit rate: 
performing a second compression pass of the 20 
digital video data by using the quantizer value 
to obtain compressed digital video data and an 
actual number of bits resulting from the second 
compression pass; and 

updating the desired bit rate to determine the ^5 
quantizer value for compression of subsequent 
digital video data as a function of the actual 
number of bits resulting from the second com- 
pression pass and a constant bit rate. 

30 

2. A method according to claim 1 wherein the first 
compression pass performing step comprises the 
step of: 

compressing a sampled subset of the digital 3S 
video data. 



data based upon a sample quantizer value 
used in the first compression pass and the 
number of bits resulting from the first compres- 
sion pass: and 

outputting as the quantizer value for the second 
compression pass, from the adjusted transfer 
function, a reccomended quantizer value. 

6. A method according to claim 1 wherein the deter- 
mining step comprises: 

restricting to a set of allowable quantizer values 
the quantizer value for the second compression 
pass. 

7. A method according to claim 1 wherein the second 
compression pass performing step comprises the 
steps of: 

inputting digital video data to a compression en- 
coder delayed by a predetermined period; 
inputting the quantizer value to the compres- 
sion encoder; 

outputting the actual number of bits resulting 
from compression of the digital video data by 
the compression encoder; and 
outputting the compressed digital video data 
from the compression encoder. 

8. A method according to claim 1 wherein the second 
compression pass performing step comprises the 
step of: 

compressing the video image data by using the 
same compression encoder engine as was 
used in the first compression pass. 



3. A method according to claim 1 wherein the first 
compression pass performing step comprises the 
step of: 



40 



compressing the digital video data using a 
JPEG compression encoder engine that is ad- 
justed to use Huffman (coding) tables to com- 
press the digital video data. 



9. A method according to claim 8 wherein: 

The first compression pass is performed during 
the horizontal and vertical blanking time be- 
tween active picture samples. 



A method according to claim 1 wherein the first 
compression pass performing step comprises the 
step of: 

compressing the digital video data using an 
MPEG Intra-Frame compression encoder to 
compress the digital video data. 



50 



5. A method according to claim 1 wherein the deter- 
mining step comprises: 



55 



adjusting a transfer function for the digital video. 
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